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Abstract 


One of the cognitive theories is the embodied cognition theory. According to this theory, it is important to 
use appropriate gestures in the process of assimilating new information and the acquisition of new skills. 
The further development of information and communication technologies has enabled the development 
of interfaces that allow the user to control computer programs and electronic devices by using gestures. 
These Natural User Interfaces (NUI) were used in teaching Chemistry in middle school and secondary 
school. A virtual chemical laboratory was developed in which students can simulate the performance of 
laboratory activities, similar to those that are performed in a real lab. The Kinect sensor was used to 
detect and analyze hand movement. The conducted research established the educational effectiveness of 
a virtual laboratory, which is an example of a system based on GBS gestures (gesture-based system). The 
use of the teaching methods and to what extent they increase the student's complete understanding were 
examined. The results indicate that the use of the gesture-based system in teaching makes it more attrac- 
tive and increases the quality of teaching Chemistry. 

Key words: chemistry experiments, educational simulation, gesture based system, embodied cognition 
theory. 


Introduction 
An Experiment in Teaching Chemistry 


In science classes, students should perform experiments because they are the carriers of 
basic information in a particular discipline. The equipment in a chemical laboratory and stu- 
dents working methods in experiments are elements of individual work, through which every 
student can practice basic skills; for example, the techniques of laboratory work (Tatli, 2009). 
In addition, the laboratory exercises and mental activities related to them, such as reasoning, 
critical thinking and scientific prediction, that cause an increase in theoretical and laboratory 
problem-solving (Odubunni & Balagun, 1991; Ayas, Cepni & Akdeniz, 1994). This motivates 
the students to self-critical thinking in designing new experiments and conducting research in 
the way scientists do. These activities must be guided by the thesis that the knowledge of reality 
is only effective when it binds with transforming it (Bozdogan & Yalcin, 2004). 
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The Development of Information and Communication Technology (ICT) 
and Chemistry Education 


The development of information and communication technologies (ICT) has a major 
impact on education, including the process of teaching-learning (Lamanauskas, 2011; Xie and 
Reider, 2013). An important issue is the proper implementation of this technology in the edu- 
cational process in such a way as to be able to support students in developing their skills and 
knowledge (Zhang, 2013). ICT can help students and teachers broaden their thought horizons 
and help them towards a better understanding of scientific phenomena and conducting inves- 
tigations before carrying out scientific research (Lamanauskas, 2011; Ebenezer, 2011, 2012; 
Calik, 2013; Zhang, 2013). This implies that the ICT tools can be useful to students in inquir- 
ing and understanding scientific concepts (Krajcik, 2002; Josephse & Kosminska, 2006). The 
authors of the article have already successfully applied ICT technology to support the student’s 
laboratory work by developing a multimedia web script for lab exercises on the subject of 
Chemistry experiments and by examining its usefulness in teaching Chemistry (Jagodzinski & 
Wolski, 2012; Chemical experiment, 2008). 


Virtual Laboratories in Science Education 


Virtual labs allow working and learning to take place in any place at any time. They leave 
the school walls and move everything to another part of the environment, making the learning 
process more dynamic by using a simulation (Yang &Heh, 2007; de Grove, 2012; Liu and Su, 
2011). In virtual labs, students were active, taking part in conducting experiments, working 
alone or with their colleagues (Dede, Salzman & Loftin, 1994). Students using virtual laborato- 
ries can work according to their pace of learning and personal needs (Sanger, Greenbowe, 2000; 
Stieff & Wilensky, 2003; Pekdag, 2010; Machkova & Bilek, 2013). In a traditional laboratory, 
work involves dealing with technical problems, complying with safety regulations, costing in 
association with equipment in addition to the performance of experiments, and reducing the 
hours devoted to laboratory work. An effective solution to these problems is in using currently 
available virtual laboratories, which, to some extent, allow experimenting without the restric- 
tions mentioned above (Millar, 2004; Bilek, 2010). The emergence of Natural User Interfaces 
(NUJ) has created new opportunities in controlling simulation programs. This control is done 
with natural user movements and gestures, making the service more natural and intuitive. It 
became possible to prepare software, which enables the user to be more involved in practical 
activities (Svec & Anderson, 1995). 


Embodied Cognition Theories in Chemistry 


There has been an increased interest in alternative presentation models, called “embod- 
ied cognition theories”, in the last couple of years. According to the theory, human knowledge 
requires a “re-experience” of an event, using sensual processes that participated in the initial 
perception of the stimulus (Barsalou, 1999; Wilson, 2002; Prinz, 2002). Behavioral studies 
suggest that bodily conditions can be the cause of cognitive states and may also be the result of 
these conditions (Barsalou, 2008; de Koning & Tabbers, 2011). So, a student mentally process- 
ing information in multimedia instructional materials, supported by body motion, causes the 
activation of brain areas that are responsible for cognitive processes. The inclusion of human 
movements to this process makes learning while using any multimedia content more effec- 
tive (Ayres, 2009; Wong, 2009). These conclusions are supported by the magnetic resonance 
imaging results, which indicated that the cerebral cortex is activated when the transmission of 
information is supported by appropriate gestures (Macedonia, Miiller & Friderici, 2010). In 
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support of this claim, Johnson (2011) determined that computer gesture recognition is a neces- 
sary technology that will have a big impact on education in the near future. Chang (2013) used 
a Kinect sensor to support the presentation of some multimedia content. They used certain ges- 
tures that functioned as wireless hot keys. These gestures were recognized by the Kinect sensor 
and were used to control PowerPoint presentations. In the studies described above, applying 
motion sensors in education caused an increase in the effectiveness of learning. This encour- 
aged us to develop a virtual chemical laboratory in which the work is based on the movement 
and gestures of the user, while being recorded and processed through a Kinect sensor. Virtual 
chemical laboratories that are currently available only operate on the basis of interfaces such 
as a keyboard and a mouse. They do not provide the natural user program behavior, such as 
while working in a real laboratory (,,Chemistry labs”, n.d.). The use of natural user interfaces 
(NUJ) (Murphy, 2012) creates new opportunities in virtual laboratory design that is based on a 
gesture-based system. 


Research Problem 


Taking into account the reports described above with regard to information and com- 
munication technology development and embodied cognition theories, a virtual chemical labo- 
ratory was prepared in which the system was used to recognize gestures and movements. The 
educational experiment was designed to examine how the use of the gesture-based system in a 
virtual chemical laboratory affects the perceptual abilities of students in the relevant taxonomy 
category of the teaching goals, 1.e., in terms of memorizing information, understanding informa- 
tion, using said information in a typical situation, and in solving problems in the laboratory. 


Methodology of Research 


At the beginning, groups of students participating in the study were assembled. In the 
first stage of the research, the students answered the questions in the pre-test (Cohen, 2011) to 
determine their initial knowledge level of the subjects, which were included in the research. 
Next, each group of students began working with their assigned educational means. The first 
student group worked with the virtual laboratory. There were five posts from the Kinect sensors 
in the classroom. During one lesson, each student simulated conducting a chemical experiment, 
working once with the virtual lab. Each student performed a chemical experiment for about 5 
minutes. In this way, 5 students finished their experiments in 25 minutes. The second student 
group worked with films depicting the course of the same Chemistry experiments, which the 
first group of students worked with. The second group of students was able to see the course 
experiment only once and the reader discussed only the next steps of the experiment. The third 
group of students watched the experiments presented by a teacher in the form of a teaching 
demonstration. The teacher also performed the same experiments, which the students from the 
first and second groups worked with. During the demonstration, the teacher went through the 
following steps in the experiments carried out (Table 1). 

The students took part in five cycles of classes, differing in themes. One thematic cycle 
consisted of two lessons. At the beginning of the first lesson, the students acquainted them- 
selves with the theoretical lessons’ material, covering a specific topic; for example, the chemi- 
cal reactions of acids with metals. In the second part of the lesson, the students, representing 
particular groups, had to learn about the planned experiments, working with an appropriate 
teaching method or by watching a demonstration by teachers. Following that, the students filled 
out a card on which they put down their observations of the experiment while formulating ap- 
propriate conclusions. In the second lesson, the students compared the results of their work. 
After completing all the planned class cycles, the students from all the groups answered the 
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post-test questions. The purpose of this test was to determine the final level of the amount 
of information gained by the students, falling within the scope of the pre-test. After that, the 
students, who worked with the virtual lab, responded to the survey. The research lasted four 
months in school year 2012/2013. It simultaneously took place in all the groups. Three months 
after the termination of the pre-test, the students answered the test questions in the delayed 
post-test. The purpose of this test was to determine among the students the level of the gained 
information’s durability. 

Two teachers were involved in this research. One of them taught all of the middle school 
student groups, while the other one taught all of the secondary school student groups. 


Sample of Research 


Three classes, representing the same middle school and secondary school, took part in 
the educational research. The study covered students in the second year in both the middle 
school and the secondary school. In each school, the particular classes represented a separate 
student research group. The different groups of students were chosen at random. The age of the 
middle school students from the second year was 14, whereas the age of the secondary school 
students from the second year was 17. Table | contains the markings of the students with their 
characteristics. 


Table 1. Groups of students, along with their characteristics. 























Students age? pembet 

Group symbols of students 
M sD N 

KG middle school students, using the virtual laboratory 13,96 0,35 25 

PG middle school students, watching their teacher presentations 14,00 0,29 25 

FG middle school students, watching movies depicting the process of the 13,96 0,20 25 

experiment 

KL secondary school students, using the virtual laboratory 17,00 0,00 25 

PL secondary school students, watching their teacher presentations 17,08 0,28 25 

FL secondary school students, watching movies depicting the process of 16,96 0,35 25 





the experiment 
a—the age of middle and secondary school students in the research, M — arithmetic mean, SD — the 
standard deviation of the mean, 





Instruments and Procedures 


The research used tests with multiple choice questions with a single answer mode. The 
questions in the pre-test, the post-test and the delayed post-test included the same range of 
topics. Each test consisted of 20 questions. The questions in the tests belonged to particular 
taxonomy categories with regard to the teaching goals. Five test questions were assigned to 
each category. The basis was the taxonomy of the teaching goals of B. Bloom (1956; Andreson 
& Krathwohl, 2001), consisting of educational goal classification, which allowed a precise 
and unambiguous description of the tested student’s ability. B. Niemierko, (1977) based on the 
taxonomy of B. Bloom, developed a taxonomy of Chemistry teaching goals. This taxonomy 
consisted of four main categories, namely: memorizing the information (A), understanding the 
information (B), using the information in an appropriate situation (C), and using the informa- 
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tion in a similarly difficult situation (D). Following these categories, appropriate questions were 
selected from a ready set of standardized Chemistry questions in tests for students of middle 
school and secondary school. For each correct answer, the student got 1 point and for each in- 
correct answer, the student got 0 points. Every student in the test could have scored 20 points. 
A diagnostic survey, according to the Likert scale survey (Likert, 1932; Gamst, 2008), was also 
implemented. The survey consisted of 10 questions. The survey questions are as follows: 

1. Did your work in a virtual laboratory affect the increase in your commitment to the 

work in a real lab? 


2. Are you more willing to work in a real lab when you have practiced before performing 
experiments in a virtual lab? 


3. Did your work in a virtual lab help to make your work in a real lab more efficient by 
decreasing the time required to perform the experiments? 


4. Did your work in a virtual lab help to make your work in a real lab more efficient by 
decreasing the number of mistakes made while performing an experiment? 


5. Did the result of your work in a virtual laboratory have an impact on encouraging you 
to verify them in a real lab? 


6. Thanks to your work in the virtual lab, would you willingly carry out more experiments 
in a real laboratory than according to the projected schedule? 


7. Thanks to your work in the virtual lab, can you easily design new chemical 
experiments? 


8. Did your thoughts about the work in the virtual laboratory affect your level of 
confidence when performing laboratory activities in a real lab? 


9. Has your work in the virtual lab strengthened your confidence in performing 
experiments with a positive outcome in a real lab? 


10. Has your work in the virtual lab increased your confidence in the growth of the work’s 
effectiveness in relation to the performance of the manual tasks in a real laboratory? 
The scale of the answers available in the survey: 


1. Strongly disagree, 2. Disagree, 3. Neither agree nor disagree, 4. Agree, 5. Strongly agree. 


The survey was carried out among students working with a virtual lab in order to ex- 
amine the students’ opinion on the use of the virtual laboratory system when supported by the 
gesture recognition system in teaching Chemistry. The survey results were to provide answers 
to the questions involving the intensity of the student’s emotional involvement in laboratory 
work and the changes in the student’s sense of self-efficiency in laboratory work. 


Data Analysis 


The research determined the growth and sustainability of the information among stu- 
dents and the educational effectiveness of the teaching measures. The determination of these 
results was based on the points earned in various tests (Jagodzinski & Wolski, 2012). The 
information increase among students from particular groups was determined by the difference 
between the results of the post-test and the pre-test. However, the students’ information sustain- 
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ability was determined by the difference between the post-test results and the delayed post-test. 
On the other hand, the effectiveness in education of the virtual laboratory in teaching Chemis- 
try was determined by the difference between the increase in information that was gained by 
students working with the virtual lab, when set against the increase in information gained by 
students from the other groups. The results were statistically analyzed in order to determine the 
statistical significance difference of the result. For this purpose, the one-way analysis of vari- 
ance (ANOVA) was used, where the assumed level of significance is a=0.05. For this was used 
STATISTICA 10 software (Statistica, nd.). 

In the survey, students could only choose one possible answer for each question. The 
answers to all the questions given to the students were studied. The results were presented in 
percentages. 


Results of the Research 
The following tables below present the summary of the calculated results of the study. 
Table 2. Results about the increase in knowledge, effectiveness of an educa- 


tional virtual laboratory and the durability of information, achieved by 
appropriate groups of middle school students (%). 





Taxonomy learning objective categories 














A B C D G (generally) 
Group symbol Increase in student knowledge 
KG 216* 242* 304* 291* 256* 
FG 138* 135* 200* 172* 156* 
PG 149* 145* 208* 188* 166* 





The determined effectiveness of an educational virtual laboratory in relation to other 
teaching aids 




















KG-PG 45 67* 46 55* 54* 

KG-FG 56* 79* 52* 69* 64* 
The determined durability of student knowledge 

KG 89* 89* 87* 88* 88* 

FG 82* 80* 71* 74* 77* 

PG 84* 85* 75* 75* 81* 





Note: The sign (*) indicates statistically significant results, determined from the ANOVA. 
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52| Table 3. Results about the increase in knowledge, effectiveness of an educa- 


tional virtual laboratory and the durability of information, achieved by 


appropriate groups of secondary school students (%). 





Taxonomy learning objective categories 
































A B C D G (generally) 
Group symbol Increase in student knowledge 
KL 109* 116* 124* 165* 125* 
FL 72* 12? 83* 100* 80* 
PL 92* 102* 85* 108* 96* 
The determined effectiveness of an educational virtual laboratory in relation to other 
teaching aids 
KL-PL 19 14 46 53* 31* 
KL-FL 51* 61* 51* 65* 57* 
The determined durability of student knowledge 
KL 85* 88* 93 92 89* 
FL 71* 66* 68* 59* 67* 
PL 78* 74* 76* 67* 74* 





Note: The sign (*) indicates statistically significant results, determined from the ANOVA. 


Table 4. The results of the diagnostic survey. 





Answers [%] 



































Questions 4* 2% 3 At 5 
G L G L G L G L G L 
1. 0 0 0 0 3 7 19 15 79 79 
2. 0 0 3 3 5 8 23 31 70 59 
3. 0 0 0 0 7 15 12 19 81 67 
4. 3 4 1 3 0 3 28 33 68 58 
5. 0 0 0 0 1 7 35 47 64 47 
6. 3 9 0 1 7 11 29 36 62 43 
7. 7 11 12 15 11 15 37 A 33 19 
8. 0 0 0 0 3 8 13 21 84 71 
9. 0 0 1 3 13 19 31 38 55 A 
10. 0 0 4 5 12 17 29 35 55 43 





Note: Answers - 1. Strongly disagree, 2. Disagree, 3. Neither agree nor disagree, 4. Agree, 
5. Strongly agree; G— middle school, L— secondary school. 
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Discussion 


For the middle school students, after the research was completed, there was a substantial 
increase in their gained information, in some cases, up to 200%. Two factors contributed to this 
phenomenon. First of all, this increase was caused by a low level of Chemistry familiarity at the 
beginning of the research. Secondly, in the adopted methodology for calculation, the basis for 
the results was obtained by the students in the pre-test. Therefore, the increase in information 
gained by the secondary school students is more than twice lower than for the middle school 
students. Therefore, the increase of information gained on the secondary school students is 
more than twice lower than that for the middle school students. This is due to the higher level of 
information attained by the secondary school students at the beginning of the research. 

The use of a virtual laboratory, which is based on a system of gestures (GBS), on second- 
ary school students, resulted in an increase in the understanding of information in relation to 
the group of students working with movie instructions and the group of students watching their 
teacher presentations. This increase was due to the use of gestures and movements by students 
while performing experiments in a virtual lab. In contrast, the group of students who watched 
movies or their teacher presentations did not perform gestures, but only watched them. For the 
middle school students, who were working with a virtual laboratory, better results in terms of 
understanding the information (B) had further consequences in the form of a better performance 
by them in terms of problem solving (C), requiring a good understanding of information and 
creative thinking (D) (Table 2). In the case of secondary school students, the efficacy results 
of the educational virtual laboratory shaped differently than in the case of the middle school 
students (Table 3). This is due to the knowledge resource these students have acquired while 
studying Chemistry at the middle school. In the case of the secondary school students who were 
working with a virtual lab and the students watching their teacher presentation, there was no 
significant difference on the basis of the first two taxonomy categories in educational objec- 
tives, that is remembering the information (A) and understanding the information (B), because, 
in both cases the involvement of students in the observations of the course of the experiments 
is similar. Watching movies on the course with the experiments is associated with less student 
involvement, as the video only shows the normal course of the experiment, and the students just 
see the gestures and movements of the experimenter. In this case, remembering and understand- 
ing the information is weaker. However, in the case of both secondary school student groups, 
seeing their teacher presentations and working with movie instructions, there is no trend ob- 
served for the ability to use information in a typical situation (C), and in resolving the prob- 
lems (D). Working with a virtual laboratory positively affects the durability of the information 
for the middle school students, because the manual activities that the students independently 
perform while working with it, force them to a greater attention and perception. It affects a 
greater degree of assimilation and understanding the information (A, B), which translates into 
problem-solving skills (C, D). This beneficial effect of working with a virtual laboratory for the 
durability of information was also observed in the case of the secondary school students. In this 
case, in addition to a greater concentration and perception of the students, an additional factor 
in the considerable durability of the information was the previously acquired knowledge while 
studying Chemistry at the middle school. 

The results of the survey (Table 4) confirm the usefulness of a virtual chemical labora- 
tory, which is using a system of gestures and movements in Chemistry education. Students 
from the study groups who were working with a virtual laboratory confirmed that this increased 
their commitment to work in a real lab. In the majority of the surveyed students, there was an 
increased willingness to work in a school Chemistry laboratory as well as an increased interest 
in the Chemistry subject. The students also felt the increased efficiency of their work, because 
they could carry out experiments in a shorter time, committing fewer errors. The positive ex- 
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periment results, obtained from the students while working in a virtual laboratory, encourage 
the students to repeat them in a real laboratory. Due to the work in the virtual laboratory, this 
has increased student ability to solve problems in a laboratory that confirms the results obtained 
by them in the activities corresponding to category D in the taxonomy of learning objectives. 
The survey results also indicate that the students have mastered laboratory activities, which 
increased their belief that they will now perform more experiments with positive results. The 
students emphasized that training in a virtual lab increased their sense of effectiveness of their 
work in a real lab. 

However, following on from our observations, at the beginning of the students’ work 
with the virtual lab, they ran into some difficulties when the teaching measure being used was 
not well known to them. This consisted of the fact that they had to be fully capable of perform- 
ing certain gestures that were appropriate for the experiment that they were going through. It 
was something new to the students, as well as there being some kind of difficulty in getting 
used to making gestures and movements in the air, as well as imitating certain laboratory activi- 
ties, but without touching actual objects. An additional complication arose from the technical 
equipment going through some slight delay in the processing by the Kinect sensor gestures and 
movements. In addition, a further disadvantage is the need to stand in front of the Kinect sensor 
while working in the virtual laboratory. Comparing the described virtual lab with already exist- 
ing similar virtual laboratories (Chemistry labs, nd.) and using such interfaces as a mouse and a 
keyboard, we can see that the use of Kinect has brought the quality of students’ work closer to 
working in real conditions. Using this type of interface has created the opportunity to prepare a 
new generation of virtual labs. 


Conclusions 


Analyzing the obtained results shows that the use of the gesture recognition system when 
using Kinect in the virtual lab had a positive impact on increasing the efficiency of teaching 
Chemistry. Students working with a virtual lab gave a better performance in terms of remem- 
bering information, and also showed the greater durability of remembering information. To 
a greater extent, students could understand the information passed to them. Moreover, it in- 
creased their ability to use the knowledge acquired in solving tasks in situations known to them 
from lessons. As a result, they achieved even better results in solving problematic laboratory 
tasks, which is related to achieving the objectives contained in the taxonomy category of learn- 
ing objectives with the highest educational value. Comparing the achievements of students of 
particular middle and secondary school groups, we can conclude that the use of gestures and 
movements in a virtual chemistry laboratory offers higher efficiency than education for students 
from the other groups. The use of a Kinect sensor recognizing gestures and movements can 
increase the interactivity and effectiveness of an educational virtual laboratory. The inclusion 
of human movements in the cognitive process makes learning that is supported by multimedia 
content by using gestures produce better results and is more effective, which confirms the as- 
sumptions embodied in the cognition theories. Indeed, in our study, groups of students who 
were working with a virtual laboratory, using gestures and hand movements, achieved the best 
results. Students from other groups watching their teacher presentations and movie instruc- 
tions, which did not use these gestures, achieved worse results, especially in solving problems. 
The results of our research regarding the application of the gesture and movement recognition 
system in the virtual Chemistry lab showed that gesture recognition computer technology will 
make a big impact on education in the future. The virtual laboratory we have developed with 
the Kinect sensor, in our opinion, is the new path to virtualization different laboratories doing 
very similar operations manually in a virtual environment to those in a real environment. The 
statements of the students who were surveyed show that the support of the GBS system of 
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educational software enhances its attractiveness and emotional involvement. All these factors 
increase students’ self-efficiency and self-confidence while working in the laboratory. 
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